Topological Semantic Mapping by Consolidation of Deep Visual Features

نویسندگان

چکیده

Many works in the recent literature introduce semantic mapping methods that use CNNs (Convolutional Neural Networks) to recognize properties images. The types of (eg.: room size, place category, and objects) their classes kitchen bathroom, for category) are usually predefined restricted a specific task. Thus, all visual data acquired processed during construction maps lost only recognized remain on maps. In contrast, this work introduces topological method uses deep features extracted by CNN (GoogLeNet), from 2D images captured multiple views environment as robot operates, create, through averages, consolidated representations regions covered each node. These allow flexible recognition other tasks. Experiments with real-world indoor dataset showed is able consolidate them objects categories properties, indicate location images, very promising results.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Visual Topological Mapping

We present an outdoor topological exploration system based on visual recognition. Robot moves through a graph-like environment and creates a topological map, where edges represent paths and vertices their intersections. The algorithm can handle indistinguishable crossings and close loops in the environment with the help of one marked place. The visual navigation system supplies path traversing ...

متن کامل

Topological Mapping with Multiple Visual Manifolds

We address the problem of building topological maps in visual space for robot navigation. The nodes of our topological maps consist of clusters along manifolds, and we propose an unsupervised learning algorithm that automatically constructs these manifolds the user need only specify the desired number of clusters and the minimum number of images per cluster. This spectral clustering like framew...

متن کامل

Parallel consolidation of simple features into visual short-term memory.

Although considerable research has examined the storage limits of visual short-term memory (VSTM), little is known about the initial formation (i.e., the consolidation) of VSTM representations. A few previous studies have estimated the capacity of consolidation to be one item at a time. Here we used a sequential-simultaneous manipulation to reexamine the limits of consolidating items into VSTM....

متن کامل

Deep Mapping of the Visual Literature

We consider how patterns of figure use in the scientific literature relate to impact, change over time, and vary across disciplines. We use a convolutional neural network to embed figures as feature vectors in a high-dimensional space, then visualize this space as a 2D heatmap to expose patterns. We consider how these patterns vary with respect to time, impact, and discipline, concluding that h...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE robotics and automation letters

سال: 2022

ISSN: ['2377-3766']

DOI: https://doi.org/10.1109/lra.2022.3149572